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Abstract 

Let S be a smooth closed hypersurface with non-negative Ricci 
curvature, isometrically immersed in a space form. It has been proved 
in [P], [CZ| . and |C2| that there are some inequahties on S which 
measure the stabihty of closed umbilical hypersurfaces or more gener- 
ally, closed hypersurfaces with traceless Newton transformation of the 
second fundamental form. In this paper, we prove that the constants 
in these inequalities are optimal. 



1 Introduction 

A hypersurface E is called totally umbilical if its second fundamental form 
A is multiple of its metric g at every point, that is, A = on E. In 

differential geometry, a classical theorem states that a closed, i.e., compact 
and without boundary, totally umbilical surface isometrically immersed in 
the Euclidean space must be a round sphere §^ and in particular, its 
second fundamental form ^4 is a constant multiple of the metric. This result 
is also true for hypersurfaces in R"'+^. 

It is interesting to discuss a quantitative version or stability of this theo- 
rem. De Lellis and Miiller fdLM] obtained an estimate for closed surfaces 
in M?. Their result also has applications to foliations of asymptotically flat 
three manifolds by surfaces of prescribed mean curvature ([M], HH), [LM] V 
Recently, Perez [P| studied the hypersurface case and proved the following 
theorem for convex hypersurfaces in M"+^: 



*the first author is partially supported by CNPq and Faperj of Brazil; 

^the second author is supported by CONACyT of Mexico and Capes of Brazil. 



1 



Theorem 1.1. (f^) Let H be a smooth, closed and connected hypersurface 
in IR"'^-'^, n> 2 with induced metric g and non-negative Ricci curvature, then 

A--g'< / A--g ', 1.1 

n n — 1 /v n 



and equivalently 



I {H-Hf<^! \A-^g\\ (1.2) 



where A and H = trA denote the second fundamental form and the mean 
curvature of T, respectively, H = y^l(^Y.-^ Ie^ average of H on T,. In 

particular, the above estimates hold for smooth, closed hypersurfaces which 
are the boundary of a convex set in R"+^. 

As pointed out by De Lellis and Topping |dLT] . Perez's theorem holds 
even for the closed hypersufaces with nonnegative Ricci curvature when the 
ambient space is Einstein. Indeed a slight modification of the proof of The- 
orem [LT] gives the following result (see its proof in |CZ] ). 

Theorem 1.2. Let (M""*"^,^) be an Einstein manifold, n > 2. Let S be 
a smooth, closed and connected hypersurface immersed in M with induced 
metric g. Assume that {^,g) has non-negative Ricci curvature. Then 

\A--g\^< / \A^-g\\ 1.3 

n n — 1 n 

and equivalently 

where A, H and H are as in Theorem \l.l\ 

Later, Zhou and the first author ([CZJ) studied the rigidity of the equal- 
ities in Inequalities ([Ll]), ([HI]), ([LS]) and ([Ll]). They proved that 

Theorem 1.3. fJC^) Let M"+i be the Euclidean space or the Eu- 

clidean semi-sphere or the Hyperbolic space W^^^ , n > 2. Let S be 
a smooth, connected, oriented and closed hypersurface immersed in M""^^ 
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with induced metric g. Assume that (S, (7) has non-negative Ricci curvature. 
Then, 

^4 - -g f = / A - -g \ 1.5 

n n — 1 /v n 



and equivalently 



I {H-Hf = ^l \A-^g\\ (1.6) 



holds if and only if H is a totally umbilical hypersurface, that is, H is a 
distance sphere 5"" in M"+^, where H = y^i^^^j^^ j^. ^ ■ 

In |CZ] . the authors also studied the general case for hypersurfaces with- 
out assumption on convexity (that is, A > 0, which is equivalent to Ric > 
when S is a closed hypersurface in M""*"^). See more details in [CZJ . 

Also in [Pj , Perez showed the constants in Inequalities (II. ip and (ll.2p are 
sharp. In this paper, we generalize his result and prove that the constants 
in Inequalities (II. 3p and (ll.4p are sharp when the ambient spaces are other 
space forms. Precisely, we prove that 

Theorem 1.4. Let {M^'^^,g) be a space form of constant sectional curva- 



ture c, n > 2. Let C < a/^zt positive constant. Then there exists a 
smooth deformation of the geodesic sphere S"^ in M^^^ so that for each 
hypersurface T^, 

[ {H-H)'>C'[ \A-^g\\ (1.7) 

and 

\A-^g\'>C'[ \A-^g\\ (1.8) 

Moreover, can be chosen arbitrarily close to S*" so that the Ricci curvature 
RicT,t ofTjt is positive. 



Theorem 11.41 shows that the constant a/^ti Inequalities (11.30 and (II. 4p 
is optimal when the ambient space is a space form. 

In this paper, we also deal with higher order mean curvatures and the 
Newton transformations of the second fundamental form of hypersurfaces 
(see their definition in Section [2l Besides we refer the interested readers to 
[Rj . [RoJ . [CRJ . [Ro2j . [C2j and the related references therein). 
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When (S,(yf) is a hypersurface isometrically immersed in a space form, 
it can be verified tliat if the Newton transformations satisfy Pr = 
on E, then S has constant rth mean curvature and thus P^ is a constant 
multiple of the metric g (cf Section [5]). Moreover, Ros' work ( |RolJ .[Ro2j) 
implies that the round spheres are the only closed embedded hypersurfaces 
in M"+^ with Pr = ^^^9, 2 < r < n. Like the case for the totally umbilical 
theorem, we may consider a quantitative version or stability of this result. 
Recently, the first author |,C2j showed that 

Theorem 1.5. JU^ Let {M^^^,g) be a space form of constant sectional cur- 
vature c, n > 2. Let he a smooth connected closed hypersurface immersed 
in M""*"^ with induced metric g. Assume that {^,g) has nonnegative Ricci 
curvature, then for 2 < r < n, 



{n - ry / {sr - s;y <n{n-l) / - ^ '—g\\ (1.9) 



and equivalently, 



s n is IT' 

where Pr and Sr = trPr denote the Newton transformations of the second 
fundamental form A ofT, and the trace of Pr respectively, = '^yJ^J^^ denotes 
the average of Sr over S. 

In Section [5]of this paper, we consider the optimality of the constants for 
Inequalities (II. 9p and fll.lOp and prove that 

Theorem 1.6. Let {M^^^,g) be a space form of constant sectional curvature 
c, n > 2. Let the natural number r (2 < r < n — 1) be given. For any given 

constants Ci < -y/^^p- and C2 < ^/n, there exist smooth deformations (Si)f 

and (^2)4 of the geodesic sphere S"' in M^^^ respectively, so that for each t, 

(sr - s;f > Cl f \Pr - ^^^^^g\', (1.11) 



(2i)t J{Si) 



)t 



n 



and 



I _ > CI / |P,-l!i^,p. (1.12) 
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where Pr,Sr andl^ are given as in Theorem \1.5\ 

Moreover, and (^2)* can he chosen arbitrarily close to S"" so that 

the Ricci curvatures Ric{Y,.)^ of {T^ijt, i = 1,2 are positive. 

Observe that by Pi = Sil — A and Si = H, Theorem 11.41 shows that 
Theorem 11.61 also holds for r = 1 . 

It is worth of mentioning that there is a parallel phenomenon in the clue of 
Riemannian geometry. Recall that the Schur's theorem states that the scalar 
curvature of an Einstein manifold of dimension n > 3 must be constant. One 
may consider the stability of Schur's theorem. See some work on this topic 
in [dLT], |GWX| . [GWT] . [GW2 J. [ClJ, [C2) . 

The rest of this paper is organized as follows. In Section [21 we give some 
notation and convention. In particular, we give the definitions of Newton 
transformation and r-th mean curvatures associated to the second funda- 
mental form. In Section [21 we prove the existence of a smooth normal defor- 
mation which is needed in the next two sections. In Section [H we give some 
evolution equations and prove Theorem 11.41 In Section [5l we prove Theorem 

[m 



2 Notation and convention 

In order to give the definition of high order mean curvatures and the Newton 
transformation associated with the second fundamental form of a hyper- 
surface, which was introduced by Reilly ^ (cf. [Roj ) . we first recall the 
definitions of the rth elementary symmetric functions and Newton transfor- 
mations. Let (Tr : M*" — 7- M denote the elementary symmetric function in 
given by 

cr^(xi, . . . = ^ Xi^---Xi^,l<r <n. 

ii<---<ir 

Let V be an n-dimensional vector space and A : V ^ V he a. symmetric 
linear transformation. Let Ci, . . . , e„ denote the orthonormal eigenvectors of 
A and rji, . . . ,rjn denote the eigenvalues satisfying Aci = rjiCi, i = 1, . . . ,n 
respectively. 

Definition 2.1. Define the rth symmetric functions ar{A), simply denoted 
by ar, associated with A by 

ao = 1, (2.1) 
ar = crr{r]i, . . . ,r]n),l < r < n. (2.2) 
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Also define the Newton transformations Pj. : V ^ V, associated witfi 
A,0 < r < n, as 

Po = I (Identidade), (2.3) 

r 

Pr = J2{-iyar.,A^ 

j=0 

= arl -ar-iA + ... + {-lYA'', r = l,...,n. (2.4) 

By definition, P^. = a^I — APr-i,Pn = 0. It was proved in [R| that Pr has 
the following basic properties: 

(i) tr(P^) = {n- r)ar; (2.5) 
(n) tr(AP,) = (r + l)a,+i; (2.6) 
(m) tT{A^Pr) = aia,+i - (r + 2)a,+2, (2.7) 

where tr denotes the trace of the corresponding transformation. 

Now assume (M, g) is an (n+l)-dimensional Riemannian manifold, n > 2. 
Suppose (S,(yf) is a smooth connected oriented closed hypersurface immersed 
in (M, g) with induced metric g. In this paper, unless otherwise specified, 
we denote by a " ~" all quantities on {M,g), for instance by V the Levi- 
Civita connection of {M,g). Also we denote for example by V,Ric,A, the 
Levi-Civita connection, the Ricci curvature tensor, the Laplacian on (S,<7) 
respectively. 

Let u denote the outward unit normal to S. The second fundamental 
form A = (Aij) of S is defined by 

A : TpE ®, TpE R, 
A{X,Y) = -~g{VxY,iy), 

where X,Y E TpJ],p G S. 

The second fundamental form A corresponds a (1, l)-tensor on TpS, which 
is called the shape operator of S and still denoted by A. Hence the shape 
operator A satisfies that A: TpH — TpS, AX = Vxi^,^ £ TpT,. 

Let rii,i = 1, . . . ,n denote the principle curvatures of S at p, which are the 
eigenvalues of A at p corresponding the orthonormal eigenvectors {ej},z = 
1. . . . ,n respectively. 

By Definition 12. H for the second fundamental form or the shape operator 
A, we have = ar{A), the Newton transformations P^ associated with A at 
p respectively, < r < n and 
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Definition 2.2. The rth mean curvature Hj. of H at p is defined by Sr — 
OHr,0<r<n. 

For instance, Hi — ^ = where H — trA is the mean curvature of E. 
Hji is called the Gauss-Kroncckcr curvature. When the ambient space M is 
a space form M"+^ with constant sectional curvature c, 

Ric ^ (n - l)cl + HA - A^. 

R = trRic = n{n - l)c + H^ - \ A\^ = n{n - l)c + 2s2- 

Hence H2 is, modulo a constant, the scalar curvature of S. 

In a local coordinate system, = {gij), its inverse 5'"^ = {g"^^). Given 
a smooth function / on E, Hess/ = V^/ denotes the Hessian of / on E. 
Throughout this paper, wc use Einstein summation convention of summing 
over repeated indices. Wc use the raising and lowering indices to change the 
type of tensor between a symmetric (2, 0) tensor and its corresponding (1,1) 
tensor. For instance. 

We denote by (•, •) the inner product of two smooth tensor fields of the same 
type on E. Given two smooth symmetric (2,0)-tensor fields (Sij) and (Ty), 

as,,), m,)) = g^^g''S,,T,i ^ S^i ^ {{Si), 

We have the notation 

= mj), m,)) = g'^g'%kT,i = TiTi = \{Ti)\'. 

When there is no confusion, we omit writting the type of tensors, for instance 
{S,T), |Tp. We denote by trT and T the trace of (2,0) tensor T and the 
traceless part of T: T = T — ^g respectively. Then 

trT = g^'Tki = T^. 

We use the notation: dtTij = -^(Tij), dtT- = ^(T/), which define two tensors 
{dtT)ij = dtTij and {dtTf- = dfTij, respectively. 
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3 A normal deformation 



Let Fq : ^ (M"+^,^) be a smooth immersion of a closed orientable 
hypersurface in a Riemannian manifold with the induced metric g. We will 
prove the short-time existence of the the following initial value problem: a 
one-parameter family F{-,t) : E x [0,T) M""*"^ of hypersurfaces = 
F{-,t) satisfies: 

§{x,t) = f(x)iy{x,t), xeE,te[0,T); 
F{x,0) ^Fo{x), xeE. ^ ' 

where f{x) is a smooth function on E and v{x,t) denotes the outer unit 
normal of E^ at F{x, t). 

The approach is to represent the hypersurface E^ as a graph in Fermi coor- 
dinates over the initial hypersurface E and then to consider the deformation 
process as a first order PDE equation for the height function. 

Let : E X (— e, e) — >■ M"+^ be an immersion, where e is sufficiently small, 
by the exponential map 

(j){x, h) = eWFo(x) hiy(Fo(x)). 

(j) induces a metric (p*g on E x (— e, e) from (M""'"\ ^). Let Xi, . . . , denotes 
a local coordinate on E. Then . . . , J^-} is a local coordinate frame 
on E X (— e, e). By the Gauss lemma, the metric (ffg satisfies 

Clearly for t fixed, 0t(E) = ^(E,t) is a hypersurface in M""^^. If E is em- 
bedded, (j) gives the so-called Fermi-coordinates on a tubular neighborhood 

of Fo(S). 

Given a smooth function -u : E — )■ (— e, e), the map -0 : E — )■ E x (— e, e) by 
il^ix) = {x,u{x)) is an immersion, i.e., the graph G{u) of m is a hypersurface 
in E X (— e, e). A local coordinate frame on G{u) is 

5-0 d du d . ^ 

dxi dxi dxi dh' ' ' 

The unit normal field n of G{u) is 
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where W{x,u{x)) = ,Jl + {^jf^y^^^^{x,u{x)). Hence 

where (J;;)^ is the projection of ^ to the tangent space of G{u) spanned by 

&7' ^ ~ i, . . . , n. 

Under the above expression, we will prove that 

Theorem 3.1. The initial value problem liS. 1\) has the unique smooth solu- 
tion for T sufficiently small. 

Proof. Consider the initial value problem of the first order PDE on S x 
[0,T),r<e: 

f(x,t) = fix)^l + (^*~gyj§^^^(x, u{x, t)), (x, t) G S X (0, T) 

u{x, 0) =0, X G S. 

(3.2) 

By the theory of the first order PDE (cf |Ca| §35-48; or [E], Chapter 3, 
Section 3), fl3.2p exists the unique smooth solution for t < T, where T is 
sufficiently small. Here the closeness of S guarantees the global existence of 
the solution. Also we may choose T sufficiently small so that u{x, t) G (— e, e). 

By the solution u{x,t) of fl3.2p . we may construct a one-parameter fam- 
ily of hyp ersurf aces, i.e., graphs G{ut), where Ut{x) = u{x,t), t G [0,T), 
parametrised by : E x [0, T) — t- S x (— e, e) satisfying 



Then 



So we have 



^(x,t) = ^t{x) = {x,u{x,t)). 

d"^ du d du , 1 . du , d 
'dt ^ ~dtdh^ ~m^W^^ ^ ~dt^dh^ ' 

-Q^{x,t) = f{x)n{x,t) + X{x,t), (3.3) 

du f d \ 



where n{x,t) denotes the unit normal of \E't(S) at \E'(x,t) and A = ^(^) 
is the projection of ^ to the tangent space of \E't(S) spanned by ^ 



1, . . . ,n. 

Let a : S X [0, T) — )■ S be a smooth one-parameter family of diffeomor- 
phisms of S satisfying 

da 

— = -^J'A, ao = Id (Identity) (3.4) 

L/i/ 
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Integrating f l3.4p directly, we obtain the unique smooth solution. Define 
= Then 

— = ^,(— )(a(x,t),t) + (-^(■,t))(a(x,t),t) 

= -A^(a(x, t),t) + f{x)u{a{x, t),t) + A<l>(x, t) 
= f{x)n{x,t). 

Finally note the exponential map </> is a local isometry. Define F : S x [0, T) — )■ 
M"+^ by F = o $. Then F{x, t) is just the solution of Problem (I5TT]) . 

□ 



4 Evolution equations of geometric quantities 



and proof of Theorem 11.4 



In this section, we will prove Theorem 11.41 Although there is a unified proof 
of it and Theorem II. 6[ we prefer to give an independent proof of Theorem 
11.41 One reason is that the evolution equations for mean curvature and the 
shape operator are much more simple than the ones for r-th mean curvatures 
and the Newton transformations Pr, 2 < r < n. We use the method by Perez 
[Pj in proving Theorem 11.11 

Let Fq : S" {M^~^^,g) be a smooth immersion of a closed orientable 
hypersurface in a Riemannian manifold with the induced metric g. Consider 
the normal deformation of hypersurfaces according to the equation: 

f(x,t) =f{x,t)iy{x,t), xeJ:,te[o,T); 
F(x,0) = Foix), xGS. ^ ' 

where f{x,t) is a smooth function on S and u{x,t) denotes the outer unit 
normal of St = F(E, t) at F{x, t). 

If the solution of (14. ip exists, the following basic evolution equations holds 
under (jH]) (cf [H], [HP] ): 
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Proposition 4.1. For any solution of f l4.ip . it holds that 

dtgij = 2fAj, (4.2) 

dtg'^ = -2fA'\ (4.3) 

dtgl = (4.4) 

dt{dvol) = fHdvol, (4.5) 

dtu = -V/, ^ (4.6) 

dtA, = -{Hessf\, + f{A%,-fRoio,, (4.7) 

m = -Af-\A\^f-fRic{u,iy). (4.8) 

In particular, when the ambient space is the space form M^^^ with the sec- 
tional curvature c, 

dtAi^ = -iHessf),j + f{A%j-cfg,„ (4.9) 

dtH = -Af-\A\^f-ncf. (4.10) 



Here and thereafter, for simplicity, we drop tlie t subscript wlierever it would 
not lead to confusion. For instance, f^and A denote the induced metric gt = 
F*{g) and the second fundamental form of {Tjt,gt) respectively. When the 
ambient space is the space form M"+^, Proposition 14. II yields 

Proposition 4.2. 

dtA^ = -{Hessf + fA^ + cfg){. (4.11) 
dt\A\^ = -2{Hessf,A) -2ftrA^ -2cfH. (4.12) 
d,\A\' = -2{Hessf,A)-2f{AM), (4.13) 

where A = A - —q. 

Proof. 

dtA> = dtiAkg'n 

= {dtAk)g'' + Akdtg''^ 

= [-(Hess/),, + f{A%k - cfgik]g''' - 2/AfcA'^' 
= -(Hess/)^ - fiA)i - cfgl 

dt\A\^ = dti^A)) 

= id,Al)A^ + Aid,A^) 

= -(Hess/ + fA' + cfg)lA^ - A^Hess/ + fA' + cfg)) 

= -2 (Hess/, A) - 2ftTA^ - 2cfH. 
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d,\k\' = d,{\A\'-^) 



dt{\A\') - —m 

n 

-2(Hess/, A) - 2fiiA^ - 2cfH + — (A/ + UP/ + ncf) 

n 

-2(Hess/, A) + —{Ressf,g) - 2f{A\A) + —{A\g) 
n n 

-2(Hess/,A)-2/(A2,A). 



□ 



In the rest of this section, we will consider the case that the ambient space 
is the space form M""*"^ and f{x,t) = f{x), that is, the normal deformation 
(13. ip . Assume that S is a closed totally umbilical hypersurface in M""*"^. It 
is well known that E must be a geodesic sphere, i.e, distance sphere §"(a), 
where a denotes its geodesic radius. Assume F{x, t) : S x [0, T) — )■ M^^^ 
be the solution of the normal deformation (13. ip . We consider the functional 
: St = F(E, t) given by 

n^t) = C' [ |Ap- / {H~H)\ (4.14) 

where C is a constant and the subscripts t of A, if and H are omitted. 

Obviously, v^(S) = 0. Next we obtain the first variation of J-" at t = as 
follows. 

Proposition 4.3. //S is totally umbilical, then ^J^(Si)|t=o = 0. 



Proof. 

-j^(so = [ dt\A\^dvoi + [ \A\^dt{dvoi) 



d 

dt' 



At t = 0, 
By dH, 



/ dt{H - Hfdvol- f {H - nf dt{dvol). 

A = 0. (4.15) 
H = H. (4.16) 
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dt{H - H)%=o = 2{H - H)dtiH - H)\t=o = 0. (4.17) 
By (l4T3ll . or directly 

= 0. (4.18) 

Hence |j-(E,)|t=o = 0. □ 

Furthermore we discuss the second variation of J-". The straightforward 
computation imphes the following conclusion. 

Proposition 4.4. Suppose (p{-,t) : S x (— e, e) W is a smooth function. If 
ip\t=o = and dt(p\t=o = 0, then 

Take <p = I^P {H — HY in Proposition 14.41 respectively. By fl4.15p . 
( I4l6|) . (HTf]) and ( l4l8|) . it holds that 



,F(S,)|i=o = / 5* |Ark=o - / dl{H - H)\=o (4.20) 
Now we will calculate the right hand of fl4.20p . 

n 

= d,Al--idtH)gi--dtgi 
n n 

= _[Hess/ + fA^ + fcgi + V/ + \A? f + ncf)gl 
= -(Hess/)i + i(A/)^^ - /(A^)! + 

= -(Hess/)K-(A/k^-/(^A)H-|Ap/^?^--///A^. (4.21) 
n n n 

In the last equality of fl4.2ip . we used the identity 

_ l\A\^g = Ak + -A- -(|Ap + —)g = fAk - -\k\^ + -A. 
n n n n n n 

13 



Note k\t=o = 0. By flOT]) . 

d,A%=o = -(Hess/)^|,=o + -(A/)^?/| 
= -(Hess/)^' 



n 

|i=0) 



i=0 



and 



d^mt=o = d,[d,{km)]\,=o 

= 2id,MU=omA]\t=o) (4.22) 

. |t=o 

|t=o 



2(Hess/)^|i=o(Hess/)^ 
2|Hess/|2i 



In order to calculate the second term of the right side of ( I4.20p . we need the 
following proposition, which was proved in [Pj. 

Proposition 4.5. /P/ Suppose (fi(-.t) : Sx(— e,e) — )■ M be a smooth function. 
LetTpit) = ^gi^Y:t) /s be average of ip{t) on S^. Then 

^Tp = d;^+fHi^-Tp). (4.23) 

For the completeness of proof, we include its proof here. 
Proof. 

dtTp 

= [^*( i/v^ )] / fdvol + ———dt{ / ifdvol) 
vol(St) vol(St) I- 



s 



[dt{ I dvol)] I Lfdvol 



2 



vol(Si) 

+ — — — / dt(pdvol+ / (pdtidvol) 

vol(St) vol(St) 



vol(Sj) 
dt^ + fH{^-Tp). 



□ 
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Taking = H in Proposition 14. 5^ we have 

dtH = m + fH{H-H). (4.24) 



0, by f]4.l6D, 


and 1^1 


= ^, it holds that 




=0 = {dtH- 


-dtH)\t=o 




= {dtH- 


-dtH-fH{H~H))\t=o 




= {m^ 


-dtH)\t=o 




= -A/ 


-\A\^f-ncf + Af+\A\^f + ncf 




= -A/ 


f-ncf + Af + —f + ncf 

n n 




= -A/ 


— ncof + A/ + nuf, 



where u = ^ + c. So 

d^iH-H)\=, = 2[dt{H -H)f + 2{H -H)dl{H -H) 

= 2[dt{H-H)f\ (4.25) 

= 2{Af + nuf-M + nujff 

Thus together with <KTI^ and yields that 

Proposition 4.6. Let Tj is a totally umbilical hypersurface in the space form. 
It holds that 

^J'i^t) \t=o = 2C' ^ \Hessf\'{0) - 2 ^(A/ + nuf - Af + nuff. (4.26) 

In the following, we will show that 

Theorem 4.1. Let M^+^ be a space form of the constant sectional curvature 
c. Then there exists a closed totally umbilical hypersurface T, in M and a 
deformation F{-,t) ofT, such that 

^^(S,)|.=.<0. 

where J^{^t) 'is given by fl4.14p with constant C < a/^zj- 
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Proof. We first consider the case of tlie simply connected space forms M""*"^, 
i.e., tlie Euclidean space M^+^jC = 0, the Euclidean sphere S""'"^,c > 0, and 
the hyperbolic space EI""'"^,c < respectively. Here for convenience we take 
the Poincare model for H"''"-'^. Given an M""*"^, its rotationally symmetric 
metric is denoted by 

g — dr^ + snl{r)rj, 

where rj denotes the metric of the unit Euclidean sphere S", r denotes the 
distance under the metric g to the pole o and sndr) is a function given by 

r, if c = 0; 

I sin(-v/cr) -r ^ a 



Now fix a number a > (in the case of E>"'^^, < a < -^) and choose S 
as the geodesic sphere S"(a) in M with the geodesic radius a centered at o. 
It is well known that E is totally umbilical. On the other hand, S has the 
induced metric g — snl{a)rj. The metric g is the metric of the round sphere 
with the radius snda) and so the Ricci curvatue of E is 

77 - — 1 

i?zcs(V/,V/) = ^--|V/p. 

sni{a) 

Recalling the Bochner formula 

^A|V/r = |Hess/|2 + Ric^(V/, V/) + (V/, V(A/)) , 
and integrating it, by the Stokes' formula, we have 

[ |Hess/|2 = [ {Aff- I Rics(V/,V/) 



L 



= [{Aff-^ [ |V/| 
|Hess/|2 = / |Hess/p - - / {Aff 

JT, Jt, 



2 



n — 1 f , . „,o n — 1 



n 
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Note that the closeness of S imphes the average A/ = 0. Assume that / 
satisfies J^f — Q (such / will be chosen later). Then 



A/ + nujf = A/ + nujf = 

and so 



f {Af + ncof-Af + ncoff = f{Af + nujff 

= f (A/f + 2na; / fAf + nW I f. 



Thus 



./s' ■ s?^c(n ^s 



- I (A/)2 - 2nuj I fAf - n'u' J 

Now we choose / to be an eigenfunction of the Laplacian on (S,^) corre- 
sponding to the nonzero eigenvalue ^(fc), that is, 

AJ^-i{k)f, Jj^O. 

It is known that on E, 

snj{a) 

Hence the nonzero eigenvalues ^{k) are 

;m = 1,2.... 

The sequence ^(/c) increases and diverges to the +00 as k tends to +00. For 
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such /, 
1 rf^ 

= (^^^^ - l)akr [f- (^^^^ - 2nu)ak) [f- n-u- [ f 



When C < y^^? the coefficient of ^^(A;) in the last equality is negative. 

Hence, if ^ big enough, the quadratic polynomial {T,t)\t=o is negative. 

By the property of ^(A;), there exists a fco sufficiently large so that k > ko, 
i^J-'(St)|t=o < 0. This is the case of the simply connected M""*"^. Observe 
that the geodesic radius a of the geodesic sphere S can be arbitrarily chosen 
only if it makes sense. 

If M"'*'^ is not simply connected, we consider the universal covering map 
TT : M — )■ M"+-^. It is known that tt is a local isometry. Let C M be 
a neighborhood of the pole o G M such that n : Q ^ 7r{Q) C M is an 
isometry. In Q, by the conclusion of the simply connected space form, there 
exists a geodesic sphere S C (with small geodesic radius) and a deformation 
F{-,t) : S X (— e,e) — )■ M, which has the conclusion of the theorem. Take 
S = 7r(S) and the deformation F{-,t) = F{n~^{-),t). Then S and J-" satisfy 
the theorem. 

□ 



The proof of Theorem I.4 For the deformation F{x, t) given in Theorem 14.11 
with So = S", the functional J-" satisfies 



^(S,)Uo = ^-^(Si)|*=o = 0, ^^(S,)|t=o<0. (4.27) 



04.27P implies that J^iT^t) < for t sufficiently small, that is, it holds on S^: 
/ [H-Hf > [ \A~-g\'. (4.28) 
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By (K^ and the identity: 



\A-^g\' = \A-^gn^{H-H)\ (4.29) 
n n n 



we have that for C < a/^zY' 

> [ \A--g\\ (4.30) 
is, 

Since is arbitrarily close to S"(a), the Ricci curvature Rics, > 0. So we 
complete the proof of theorem. 

□ 



5 Proof of Theorem 11.6 



In this section, we first give the needed evolution equation of Sr (roughly r-th 
mean curvatures) under the general normal deform. Next we prove Theorem 
11.61 For r > 2, instead of calculating the complicated evolution equations of 
Pr, we compute directly the corresponding values at t = by using the fact 
that S = So is totally umbilical (see (I5.29P ). 

Consider the normal deformation F{x, t) of hypersurfaces in (14. ip . Recall 
a result proved by Reilly [R) . 

Proposition 5.1. [Rj Let B = B{t) be a smooth one-parameter family of 
diagonalizable linear transformation of the vector space V , ar the symmetric 
functions of the eigenvalues of B and Qj. the Newton transformation with 
respect to B. Then for r = 0, 1, . . . , n we have 

dtar+i = tr{{dtB)Qr). 
Applying Proposition 15. II to the shape operator A, by (14. lip , we have 

= tl{idtA)Pr-l) 

= -tr(P^_iHess/) - ftT{Pr-iA^) - c/trP^_i. 
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By (1231) and ([22D, 



d 

— (sr) = -tr(Pr-iHess/) - /(siSr - (r + - c(n - r + l)sr-i. 

So it holds that 

Corollary 5.1. /RJ Under (KT^ . 

= -tr{Pr-iHessf) - ftr{Pr-iA^) - cftrPr^i (5.1) 
= —tr{Pr-iHessf) — /(sis^ — (r + l)sr+i) — c{n — r + (5.2) 



To show Theorem II. 6[ we will use the same approach as in the proof of 
Theorem ll.4[ In the rest of this section, we assume that F{x, t) : S x [0, T) — )■ 
M^"+i is the solut ion of the normal deformation f l3 . 1 p and S is a totally 
umbilical hypersurface. Define the functional ^ : = F(S,t) — )■ M given by 

g{j:t) = c^ [ |P.r- / {sr-s;)\ (5.3) 

where C is a constant and the subscripts t of P^, Sr and are omitted. 
First we need some combinatorial identities. 



Proposition 5.2. 



1=0 ^ ' 



n — 1 
r 



(5.4) 



n('"*^) = ("->■)(") (8-6) 



1=0 ^ 



2 = - 1 (5.7) 



r — ij \r — 1 

f l5.4p . f l5.5p and fl5.6p are well known. Since we couldn't find the adequate 
reference for (15. 7p . for the completeness of the proof, we prove ( 15. 7p here. 
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Proof. 

z — / \r — I 

i=0 ^ ^ i=0 ^ ^ 



r 



-^£(-^)- '"-''---'';^-V'"'"' ^-C'" 



i=0 ^ ^ ^ 



-ri 



r 



— 2\ fn — 1 
—n\ + r 



r — 1/ \ r 

n — r fn — l\ fn — 1 

—n I + (n — r) 



n — l\r — 1/ \r — 1 

n — r fn — 1 



n — 1 \r — 1^ 

In the verification of ([53D, we used ([53]). By <^Mi and (EH]), 



(5J 



1=0 ^ 



□ 

Recall that S is a closed totally umbilical hypersurface, i.e., a geodesic 
sphere §"^(0) with the geodesic radius a in the space form M""*"^. Denote by 
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A the principle curvatures of E. A is a constant. So for E = Sq, 

H = nA, (5.10) 

A = —I = \I, (5.11) 

n 

A'' = X^I, (5.12) 



(5.13) 

n<---<jr n<---<ir 
= s^. (5-14) 

Moreover, by the definition 02.41) of P^. and fl5.4p . for 1 < r < n, 

r 

Pr = J2^-iy'r-,A^ 



3=0 

n 



E(-i)'( 

i=o ^ 



A"~^A^/ 

^ - J/ 



r 

By dlS]), dEl, (EH, and ([515]). 

= 0. (5.16) 

So ( I5.16P and (I5.14p imply that Q(llt)\t=o = 0. The first variation of Q at 
t = can be calculated as follows. 

= [ft(p.)l](p.)}i*=o + (p.)la,[(p.);]i,=o 

= 0. (5.17) 

dt{sr -s;.f\t=o = 2{sr -s;)dt{sr - s;)\t=o = 0. (5.18) 

So 

d 



dt 



g{T.t)\t=o = [C^ I \Pr?dt{dvol) + C^ [ dt{\Pr\')dvol 

- / dt{sr -Xfdvol - {sr -s;ydt{dvol)]\t=o 
Jt. Jt. 



= 0. 

We obtain that 
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Proposition 5.3. For S, j^g{Et)\t=o = 0. 

Next we calculate the second variation of QiJ^t) at t = 0. By (I5.14p . 
flsnej) . (ISTTj) and f l538|) . Proposition g3] implies that 

^Q{^t)\t=0 = C l^d^\Pr\'\t=0 - ljhSr-S;.)%=o. (5.19) 

We have 

a,(|p.p) = [a,(p.H](^)5 + (p.)na,(p.H], 
d^(\Pr\') = [a,a,(p.)i](p.)} + 2[a,(p.)]][a,(p.)}] + (p.)f[9,a,(p.)a 

So 

a,^(|P.r)|i=o = 2[dtiPrmdtiPr)]]t=o = 2|aiP.|Lo, (5-20) 

where the (1, l)-tensor dtPr is defined by {dtPr)l '■= (9t[(Pr)^]. On the other 
hand, we have 

d^{Sr — 'S^y = 2{Sr — 'S^)d^{Sr — S^) + 2[dt{Sr — 'S^)]'^ ■ 

df{sr - s;f{Q) = 2[dt{sr - s;)]2(o). (5.21) 
So (ICTD . f lCTD and (ICTl) imply that 
Proposition 5.4. 

^6;(S0|t=o = J^{dt\Pr\)%=o - 2 j^dtisr - ^)]\=o- (5.22) 
By dlS]), dSH), dEISD and (jEISD, 



^(..)k^o 



dt 

y-\Af + nX^f + ncf). (5.23) 



I trHess/|,=o - f^-' _ J) X'n - ncfy-' _ J 



n — 1 
r — 1 

Note on S, v4 = XI. Hence on S, v4(Hess/) = (Hess/)y4. This property let 
us prove the following conclusion. 
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Proposition 5.5. 

dt{A^)l\t=o = -m[{Hessf)A^-^ + fA^'^^ + cf{A^-^)l\t=o (5.24) 
= -mX^~^[Hessf + \^fI + cfIl\t=o (5.25) 

Proof. We give the argument by induction. The conclusion holds for m = 1. 
Suppose 9t(A'")^|i=o = -m[(Hess/)A'^-i + + cf{A'^-^)]{\t=o- Then 

ai(A-+i)^l,=o 

= d,mAni]\t=o 

= mi){A-)i\,=o+AndMni]\t=o 

= -[Ressf + fA' + cfI]^iA"^)iU=o 

-mAf [(Hess/)A™-i + fA^^' + cf{A"^-')]i\t=o 
= -{m + l)[(Hess/)A" + fA"^+' + cf{A^)]i\t=o. 

By induction, (I5.24p holds. Take A = XI. Then 

dt{A"^)i\t=o = -m[A"^-i(Hess/) + /A^+^J + cfX"'-'l]i\t=o, 
which is just (I5.25p . 

□ 

Proposition 15.51 implies the following 
Proposition 5.6. 

dtiPr)l\t=o = y-'(^^~^^{Hessf)l\,=o, (5.26) 

\dtPrn=o = A^('-^)(^2^y|ife../n,=o, (5.27) 

where Hessf = Hessf — —I. 
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Proof. By the definition ([23D of 

/r-1 



\t=0 



\m=0 



r-1 



m=0 m=0 

V r — m — 1 / 

m=0 L \ / 



+ ^ V^'^h^^A^-^fHessZ + JA^J + c//)]. (5.28) 

\r ~ m I 



By (1531) and 



t=o 

^ 3 ^"j y-i(A/ + nfX' + ncf)I + ^ ^"j [Hess/ + fX'l + fcl] 



r-1 fn - 2 



= -A'-^ (^^ _ J [(A/)/ + (n - 1)/A2J + (n - l)c// - Hess/]^ 
Note = - ^SrQ and dtgl = 0. By iK2^ and (l5:29|) . we liave 



(5.29) 



dtiPr)l\t=o 
[dtiPr)i 



[dtSrjgi 



rdt9i]\t=o 



+ 



n n 
-y^' il Z [(A/)/ +{n- l)fX'l +{n- l)cfl - Hess/]] 
n — r /n — V 



A 

y-l 



n \r — 1 
ifn-2 



r — 1 
n-2 
r — 1 



X-\M + nf\' + ncf)Il 



Hess/-i(A/)/ + (n-l)c// 
n 



(Hess/)] 



(5.30) 
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flOU]) yields 

n 

= A2(^-^)("3^y|Hess/p (5.31) 

□ 

Take 9? = in Prop 14.51 It holds that 

dtSr\t=0 = [fH{Sr — Sr) + f^jS^J \t=0 = dtSr\t=0 

= -^•'-'(":i)("^'+'')7 

We will choose / later so that / = 0. For such /, 

dts;\t=o = 0. (5.32) 

Using ( I5.23p . ( I5.27P and ( I5.32p . by Proposition I5.22t we may calculate the 
second variation of ^ at t = as follows: 
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1 d"^ 

-^^(S,)|,=o 



A2(r-1) 



= A«'-«("3jy |a|^(A/)2 + ^^/A/ + 7^/^} (5.34) 

where a = E^Sf " L = C-'=|i&IT - + ^ = + <=)'^ 

■'■^ ^ ^ ' then a < 0. Similar to the proof of Theorem 14.11 we can 

prove that 

Theorem 5.1. Let M^"*"^ he a space form of the constant sectional curvature 
c. Fix 2 < r < n — 1. Given C < \J~^^^, there exists a closed totally 
umbilical hypersurface H in M and a deformation F{-,t) ofH such that 



where QiJ^t) is given by (15. 3p . 

The proof of Theorem \1.6[ Let F{x,t) be the deformation given in Theorem 
15.11 with So = S" and C = Ci < -^/^^p- . Then Theorem 15.11 imphes that 
for t sufficiently small, 

{Sr - > Cl [ \Pr - (5.35) 

Take {^i)t = ^ot sufficiently small t. So (II. lip holds. 



Given C2 < v^, let = j^iCl - 1). Then Ci < y^g^. By 
and the identity: 



\2 



_ (n-^ ^ ^ + ijl:zll^,^ _ 5,)., (5.35) 

n n n 
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it holds that there exists a deformation S^, denoted by (^2)4 so that 



Clearly, the Ricci curvature Ricst of is positive for t sufficiently small. 
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